Method and apparatus for providing tactile sensations

ABSTRACT

Abstract of Disclosure 
     Products and processes for providing tactile sensations to input devices or electronic devices are provided.  Input devices include mechanical input devices (such as, for example, mechanical switches) and non-mechanical input devices (such as, for example, touchpads).  Tactile feedback is provided by using an actuator or other means in communication with the input device or electronic device.  A controller may be employed to receive signals from the input devices and control the actuator.  Tactile feedback to an input device or electronic device may be provided in response to one or more events or situations.  Such an event or situation may be any one designated.  Examples of such events and situations include the level of pressure placed on an input device; the availability or lack of availability of a function associated with an input device; and the function, menu, or mode of operation associated with an input device&#34;s activation.  A variety of feedback types and combinations may be selected.

Cross Reference to Related Applications

[0001] This application claims priority to U.S. Provisional ApplicationNo. 60/335,493, filed November 1, 2001, and U.S. Provisional ApplicationNo. 60/399,883 filed July 31, 2002. The entire disclosure of bothapplications are incorporated herein by reference.

Background of Invention

[0002] The present invention relates to methods and apparatus forproviding tactile sensations.

[0003] Conventional electronic devices, such as mobile telephones andPersonal Digital Assistants (PDAs), include visual displays. A user ofsuch devices interacts with the visual display using any one of a numberof input devices. Examples of such input devices include computer mice,joysticks, trackballs, steering wheels, stylus, tablets,pressure-sensitive spheres, scroll wheels, keyboards, and keypads. Theuser provides instructions, responses, and other input to the deviceusing such input devices.

[0004] In conventional mobile telephones and PDAs, confirmation of theinput provided by the user is primarily limited to visual or audibleconfirmation. In some such devices, physical feedback is provided byconventional mechanical switches in the form of the conventionalmechanical feedback of switches, for example the switch closureforce-displacement profile. Typically, in such devices, the mechanicalfeedback provided by each button is identical. In addition, in suchconventional devices, for those buttons that serve multiple functions,the mechanical feedback generally remains the same regardless of thecurrent function of the button.

[0005] In addition to providing extremely limited and rudimentarymechanical confirmation of button selection, conventional buttons asused, for example, in keypads for mobile telephones and PDAs, providesimple passive touch cues regarding the alignment of keys. Such cuesinclude raised bumps on the center key of a telephone keypad or on the"F"and "G" keys of a keyboard that assist a user in orienting to thepattern of keys in the keypad and keyboard. Again, these physical queuesare very limited, and users typically need to view a keypad or keypadfor visual confirmation that the correct instructions or information isbeing entered.

[0006] When a flat surface interface device is used, such as a touchpadfor a computer or PDA, these simple mechanical cues are unavailable tothe user. Often, touchpads are combined with flat-panel display screensthat display one or more graphically generated buttons or softkeys.Normally, the softkeys are visible through the touchpad. A user"scontact with the touchpad in an area defined by a softkey provides theelectronic device having the touchpad with the input associated withthat softkey.

[0007] The use of electronic devices using such conventional mechanicalbuttons and touchpad arrangements are particularly difficult to use indistracting environments or when the user is attempting to performanother task simultaneously with using the electronic device. Forexample, if the other task involves operating a motor vehicle or heavymachinery, it may be difficult or impossible for a user tosimultaneously use such an electronic device because such devicestypically require the user to look at the device, at least briefly, wheninteracting with the device. In addition, electronic devices relying onsoftkeys can be difficult to read in bright light environments such asin bright sunlight and can contain very small fonts and graphics thatare difficult to read and select.

[0008] Some conventional touchpads include vibratory feedback to theuser of the touchpad. U.S. Patent No. 5,977,867 is one example. Suchconventional systems and methods are limited, though. They lack a fullrange of functionality assistance to a user interacting with anelectronic device. Moreover, such systems and methods still requireconsiderable visual attention from the user.

Summary of Invention

[0009] The present invention comprises products and processes forproviding tactile sensations to input devices or electronic devices.Input devices include mechanical input devices (such as, for example,mechanical switches) and non-mechanical input devices (such as, forexample, touchpads). Tactile feedback is provided by using an actuatoror other means in communication with the input device or electronicdevice. A controller may be employed to receive signals from the inputdevices and to control the actuator. Tactile feedback to an input deviceor electronic device may be provided in response to one or more eventsor situations. Such an event or situation may be any one designated.Examples of such events and situations include the level of pressureplaced on an input device; the availability or lack of availability of afunction associated with an input device; and the function, menu, ormode of operation associated with an input device"s activation. Avariety of feedback types and combinations may be selected. Mobiletelephones and PDAs benefit from employing such products and processes,but other devices benefit as well. The advantages offered by the variousembodiments of the present invention may be understood by examining thisspecification.

Brief Description of Drawings

[0010]Figure 1 is a perspective view of an embodiment of an apparatusaccording to the present invention; Figure 2 is a plan view of anotherembodiment of an apparatus according to the present invention;Figure 3is a plan view of an electronic device including an embodiment of thepresent invention;Figure 4 is a schematic representations through line4-4 of Figure 3;Figure 5 is a plan view of another electronic deviceincluding another embodiment of the present invention;Figure 6 is aschematic representations through line 6-6 of Figure 5;Figure 7 is ablock diagram illustrating an embodiment of the apparatus in anelectronic device;Figure 8 is a flow chart illustrating a methodaccording to the present invention;Figure 9 is a table illustrating afirst set of data to be used in one embodiment of the present invention;andFigure 10 is a table illustrating a second set of data to be used inanother embodiment of the present invention.

[0011]Figure 11 is a plan view of another embodiment of the presentinvention.

Detailed Description

[0012] The present invention includes methods and systems for providingtactile sensations. One embodiment includes methods and systems forproviding tactile sensations to input devices, both mechanical andnon-mechanical (for example soft-keys that are computer generated anddisplayed on a screen). Embodiments of the present invention can beutilized in wide variety of electronic devices including telephones,mobile telephones, remote controls, gamepads, joystick handles,automotive controls (radios, Compact Disc (CD) players, automobilefunctions, etc.), consumer electronics devices, Personal DigitalAssistants (PDAs), personal computers, laptop computers, portable gamingdevices, pagers, I-pagers, audio equipment, televisions, security oralarm systems, Automated Teller Machines (ATM), calculators, homeappliances, and white goods.

[0013]Figure 1 shows one embodiment of the present invention. Theapparatus 1 shown in Figure 1 includes an input device 2 having multiplepositions for communicating a plurality of input signals. The inputdevice 2 can be any device capable of transmitting an input signal. Inthe embodiment shown, the input device 2 is a rocker-type switch. Therocker switch 2 shown can pivot or rock between two positions in whichthe rocker switch contacts and activates one of two rubber switches 3containing conductive pads. The use of rubber switches 3 provides theadvantage of allowing the user to still feel a substantial vibration orforce through the input device 2 when the user had fully depressed theswitch. Suitable rubber switches are available and known in the art. Inother embodiments, the input device may include an analog switch, aforce sending resistor, a strain gauge based sensor, a capacitativetouch switch, a scroll wheel, a mini-joystick, a touchpad, a touchscreen, a 3-way switch, a 4-way switch, a 5-way switch, or other inputdevice. Each position of the input device 2 corresponds to one of theinput signals.

[0014] The input device 2 and rubber switches 3 are mounted on a PrintedCircuit Board (PCB) 4 in the embodiment shown to facilitate electricalcommunication between the input device 2 and an electronic device (notshown). The PCB 4 can be custom shaped according to the device intowhich the apparatus 1 is placed. The PCB 4 also provides for securemounting within the device by including, for example, a plurality ofholes 5 to accept fasteners for securing to the electronic device. Inanother embodiment, the input device 2 can be directly connected ormounted in the electronic device.

[0015] The apparatus 1 shown in Figure 1 also includes a vibrotactileactuator 6 in communication with the input device 2. Preferably, theactuator 6 is configured to output a plurality of distinct tactilefeedback sensations to the input device 2. Suitable tactile sensationsinclude vibrations, for example, jolts and textures, and a plurality ofdistinct tactile sensations can be created by varying the frequency,amplitude and waveform output by the actuator 6. The actuator 6 isselected to deliver the desired tactile sensations to the input device 2The actuator 6 shown in Figure 1 is a voice coil actuator. Othersuitable actuators include, for example, piezo-electric actuators,eccentric mass actuators, moving magnet actuators, and friction brakesin contact with metal shafts. In addition, the actuator can include aflexure, for example an arrangement of flexible material, couple to therotating shaft of a DC motor or step motor to transform the rotation ofthe motor shaft into vibrations or other haptic sensations. Variousarrangements of a flexure coupled to a motor may be used as an actuator.For example, U.S. Patent Application No. 09/585,741, filed June 2, 2000,illustrates suitable arrangements of flexures and motors for use as anactuator in embodiments of the present invention. The entire disclosureof the application No. 09/585,741 is incorporated herein by reference.Tactile sensations can also be delivered to the input device 2 from aspeaker included with an electronic device into which the apparatus isplaced, for example the speaker in a mobile telephone or in a personalcomputer.

[0016] Although the embodiment shown in Fig. 1 includes one input device2 and one actuator 6, other embodiments include a plurality of inputdevices, all in communication with a single actuator. Alternatively, anembodiment can include a plurality of actuators each in communicationwith at least one input device. Various arrangements of actuators incombination with input devices are suitable for use in the presentinvention. For example, U.S. Patent Application No. 09/263,263, filedJuly 26, 2001, published on March 21, 2002, as U.S. Patent Pub. No.US2002/0033795 illustrates actuators in combination with input devicesthat may be used in embodiments of the present invention. The entiredisclosure of application No. 09/263,263, Pub. No. 2002/0033795 isincorporated herein by reference.

[0017] As mentioned, the actuator 6 is in communication with the inputdevice 2. In the embodiment shown in Figure 1, the actuator 6 is incommunication with the input device 2 through a cantilevered beam orlever arms 7 attached to the pivoting rocker, amplifying the effectiveforces of the actuator 6 felt by the user. The tactile sensationsgenerated by the actuator 6 propagate through the lever arm 7 to theinput device 2. Suitable materials for the lever arm 7 are capable oftransmitting the tactile sensations and can be, for example, metal. Thelever arm 7 shown includes one or more bends 8 to fit within theelectronic device in which the apparatus 1 is disposed. Different shapesof bends may be used to fit within the electronic device. In anotherembodiment, the actuator 6 is mounted directly to the input device 2 orto any component of the input device. Alternatively, the actuator 6 ismounted to the PCB 4 to which the input device is attached,communicating tactile sensations to the input device through the PCB. Inanother embodiment, the actuator is an existing eccentric mass motor asis used, for example, as a vibrating ringer in a pager or mobiletelephone.

[0018] The vibrotactile actuator 6 can also be mounted to a portion ofthe case or housing of the electronic device in which the apparatus 1 isdisposed, communicating the tactile sensations to the entire electronicdevice. In one embodiment, two actuators can be incorporated in the caseor back of an electronic device, for example the case of a mobile phonein an area that contacts the user"s hand. This arrangement effectivelydoubles the amplitude of the tactile sensation, and the user"s fingersdo not tend to attenuate the tactile sensation.

[0019] The apparatus 1 also includes a controller 9 in communicationwith the input device 2 to receive the input signals therefrom. Thecontroller 9 can also receive additional information from the inputdevice 2 including the position of the input device 2 and the amount ofpressure applied to the input device 2. In one embodiment, the inputsignal includes information related to the amount of pressure applied tothe input device 2, information related to the position of the inputdevice 2, or a combination of information about pressure and position.In addition to being in communication with the input device 2, thecontroller 9 is in communication with the actuator 6 to produce atactile sensation in the actuator 6 corresponding to the input or inputsignal received by the controller 9 from the input device 2.

[0020] The controller 9 is located in a suitable location according tothe needs of the device in which the apparatus 1 is placed. In oneembodiment, the controller 9 is attached to the PCB 4 as shown inFigure 1. Suitable controllers, include, for example, digital logicalprocessors capable of processing input, execute algorithms, and generateoutput as necessary to created the desired tactile sensations in theinput device in response to the inputs received from that input device.Such controllers may include a microprocessor, an Application SpecificIntegrated Circuit (ASIC), and state machines. Such controllers include,or may be in communication with, media, for example computer readablemedia, which stores instructions that, when executed by the controller,cause the controller to perform the steps described herein as carriedout, or assisted, by a controller. On embodiments of a suitablecomputer-readable medium includes an electronic, optical, magnetic, orother storage or transmission device capable of providing a processor,such as the processor in a web server, with computer-readableinstructions. Other examples of suitable media include, but are notlimited to, a floppy disk, CD-ROM, magnetic disk, memory chip, ROM, RAM,ASIC, configured processor, all optical media, all magnetic tape orother magnetic media, or any other medium from which a computerprocessor can read. Also, various other forms of computer-readable mediamay transmit or carry instructions to a computer, including a router,private or public network, or other transmission device or channel.

[0021] In one embodiment, the apparatus 1 includes a dedicatedcontroller 9 for use specifically with the apparatus 1. This embodimentis particularly well suited for applications where the apparatus 1 isretro-fitted into an existing electrical or electronic device. Inanother embodiment, the controller 9 is the microprocessor or CentralProcessing Unit (CPU) of the electronic device in which the apparatus 1is disposed. The apparatus 1 can also include additional circuitry suchas the drive circuitry (not shown) necessary to create the tactilesensations in the actuator 6 in response to input from the controller 9and a memory medium for storing data to be accessed by the controller 9for example a correlation between the tactile sensations to be producedin the actuator 6 and the input information or input signal receivedfrom the input device 2.

[0022]Figure 2 shows another embodiment of the present invention. Anapparatus 60 shown in Figure 2 includes multiple input devices. Thesemultiple input devices include twelve fixed or pre-assigned alphanumericinput buttons 10a-l, three pre-assigned function buttons 11a-c, andthree assignable function buttons 12a-c. The plurality of inputs devicesare arranged according to the electronic device in which the apparatus60is situated. In the embodiment shown, the plurality of input devicesare arranged as the keys in a key pad for a telephone or mobiletelephone.

[0023] Embodiments of the present invention include an input devicehaving a means for determining or sensing pressure. The input device iscapable of resolving multiple levels of pressure placed on the inputdevice, and of transmitting a signal associated with the level ofpressure placed on the input device. These multiple levels of pressuremay be defined by, for example, the physical location of, or distancetraveled by, a switch-type input device in the x-plane when pressed by auser (higher / lower), the magnitude of pressure placed on atouchpad-type input device, or other means.

[0024] The buttons of Figure 2 are illustrative of such an embodiment.Each of the alphanumeric input buttons 10 shown in Figure 2 is a keypadbutton. Each of the buttons 10 is capable of resolving multiple levelsof pressure placed on the buttons 10. For example, the button 10i(corresponding to the number 9 on the keypad) is capable of resolvingfive levels of pressure placed on the button 10i. In the embodimentshown, the first level is a state in which no pressure is placed on thebutton by a user, the second level being a first magnitude of pressureplaced on the button (greater than no pressure placed by the user), thethird level being a second magnitude of pressure placed on the button(where the second magnitude of pressure is different from or greaterthan the first magnitude), the fourth level being a third magnitude ofpressure placed on the button (where the third magnitude is differentfrom or greater than the second magnitude), and the fifth level being afourth magnitude of pressure placed on the button (where the fourthmagnitude is different from or greater than the third).

[0025] In button 10i, each of levels two through five is associated witha distinct input signal. When the button 10i is in its first state, thenthe button 10i does not transmit an input signal. When pressure isapplied to the button 10i by a user that exceeds the first magnitude ofpressure, the button 10i transmits a first signal to the controller 9.When greater pressure is applied to the button 10i that exceeds thesecond magnitude of pressure, the button 10i transmits a second signalto the controller. When still greater pressure is applied to the button10i that exceeds the third magnitude of pressure, the button 10itransmits a third signal to the controller. When even greater pressureis applied to the button 10i that exceeds the fourth magnitude ofpressure, the button 10i transmits a fourth signal to the controller.The structural arrangement of the communication by the button 10i to thecontroller 6 of an input signal is further illustrated in Fig. 4,described below.

[0026] Each of the levels two through five of button 10i (and thus eachof their associated signals) is associated with a letter, W-Z. Thesecond level is associated with the letter W, the third level isassociated with the letter X, and so on. The second level is associatedwith the letter W, the third level is associated with the letter X, andso on. In the embodiment shown, the key 10i has five positionscorresponding to no pressure, and the letters W, X, Y, and Z. In analternative embodiment, the key 10i has six positions corresponding tono pressure, the number "9,"and the letters W, X, Y, and Z.

[0027] In the embodiment shown, the alphanumeric buttons 10 are allcapable of resolving five levels of pressure. In alternativeembodiments, the various buttons are capable of resolving differinglevels of pressure. For example, in an alternative embodiment, while thebutton 10i is capable of resolving five levels of pressure, the button10b (corresponding to the number 2 on the keypad) is capable ofresolving four levels of pressure placed on the button 10b (the firstlevel being no pressure placed on the button). Like button 10i, thelevels resolved by button 10b in the alternative embodiment are eachassociated with a distinct input signal, and are each associated with adistinct letter of the alphabet, A-C.

[0028] The pre-assigned function buttons 11a-c of the apparatus 1 arekeypad push buttons. Each of the buttons 11a-c is capable of resolvingthree levels of pressure placed on the buttons 11a-c no pressure, afirst magnitude of pressure (greater than none), and a second magnitudeof pressure (greater than the first magnitude). Examples of functionscarried out by such pre-assigned function buttons 11 a-c include"Send"11a, "Power" 11b, and "End Call"11c.

[0029] In the embodiment shown, each of the pre-assigned functionbuttons 11 a-c is configured such that the first magnitude of pressureis an amount of pressure that signifies that a user"s finger is"hovering" over, or touching with more than passing force, the button.Each is also configured such that the second magnitude of pressure is anamount of pressure that signifies that a user"s finger applies when theuser wishes to activate the button.

[0030] Thus, in the embodiment shown, when a user"s finger "hovers"overthe "Send"button 11c, a first signal is transmitted by the button 11c tothe controller. And, when a user"s finger activates the "Send" button11c, a second signal is transmitted by the button 11c to the controller.

[0031] The assignable-function buttons 12a, 12b, 12c are buttons whosefunction depends upon the mode of operation of the device with which theapparatus 1 is associated. For example, when such an apparatus 1 isassociated with a mobile telephone, such buttons 12a, 12b, 12c may beused to navigate the menus displayed to carry out various functions,such as scrolling through an address book, selecting a number to dial,editing a number, re-setting the time displayed, and similar functions.

[0032] In addition, the assignable-function buttons 12a-c are configuredsimilarly to the pre-assigned buttons 11a, 11b, 11c, in that the buttons12a, 12b are configured such that the first magnitude of pressure is anamount of pressure that signifies that a user"s finger is "hovering"over, or touching with more than passing force, the button, and suchthat the second magnitude of pressure is an amount of pressure thatsignifies that a user"s finger applies when the user wishes to activatethe button. Preferably, the buttons 11a, 11b, 11c, 12a, 12b, 12c areconfigured such that they receive and analyze other data in determiningwhether the user is merely hovering or, instead, wishes to activate thebutton (such as type of, and duration of, contact with the button). Anysuitable input-device may be used an an assignable-function inputdevice. Examples of such input-devices include rocker-switches andscroll wheels.

[0033] In an alternative embodiment (not shown), the middleassignable-function button 12c, includes the input device of Fig. 1. Itis in communication with the actuator 6 (not shown) shown in Fig. 1 aswell, and operates in the manner described with reference to Fig. 1. Insuch an embodiment, the PCB 62 is separated at line 62a, such that thePCB4 of Fig. 1 is not in contact with PCB62.

[0034] Referring again to Fig. 2, although in the embodiment shown therethe alphanumeric keys have four or five available states (embodying analphanumeric-character selection), and the pre-assigned buttons 11a,11b, 11c, and the assignable-function buttons 12a, 12b, 12c areconfigured to indicate hover / activation signals, in other embodiments,other configurations may be used. Moreover, although the alphanumerickeys 10 have four or five available states, thus allowing them to beassociated with three or four (or more) input signals, such keys 10 maybe configured to provide input signals at, for example, only two of thestates. In this way, such keys 10 may be configured to provide hover /activation signals similar to that which is provided in the pre-assignedbuttons 11a, 11b, 11c, and assignable-function buttons 12a, 12b, 12c inthe embodiment shown in Fig. 2.

[0035] Moreover, in the embodiment shown, the levels for thealphanumeric input devices 10 correspond to magnitudes of pressure, butin other embodiments the levels resolved can be type of touch,magnitude, physical position of the switch and other attributes ofcontact with the button, or some combination thereof. The input signalsprovided by such input devices may be configured accordingly.

[0036] In the embodiment shown in Fig. 1, the input signals that aretransmitted by the input devices are transmitted to a controller 9. Inthe embodiment shown, the controller is in communication with storagememory (not shown). Examples of such memory includes Read Only Memory(ROM). The storage memory includes a table in which input signals areassociated with various haptic feedback signals. This is explained morefully in relation to Figures 9-10.

[0037] The apparatus 1 shown in Fig. 2 also includes an actuator 61. Theactuator 61 is shown in representative fashion in Fig. 2, and not toscale or in physical placement. An alternate actuator 61 and physicalplacement of the actuator 61 is shown in Fig. 4. The actuator 61 is incommunication with the various input devices, and is configured toprovide vibrations of varying frequencies, magnitudes, and wave-forms tothe input devices. The actuator 61 is also in communication with thecontroller 9. Further description of embodiments of such communicationand configuration is provided below.

[0038] In the embodiment shown, the controller 9 receives an inputsignal from one of the input devices. The controller 9 then analyzes theinput signal received to determine a signal to transmit to the actuator61.

[0039] For example, the controller 9 of Fig. 2 is configured such thatwhen the controller 9 receives a signal associated with the second levelfrom button 10i (the "9" key), the controller 9 sends a first controloutput signal to the actuator, and when the controller receives a signalassociated with the third level from the button 10i, the controllersends a second control output signal to the actuator 61, and so on. Thefirst control output signal is one that causes the actuator to provide avibration of a certain, first frequency. The second control outputsignal is one that causes the actuator to provide a vibration of acertain, higher frequency, and so on. In other embodiments, thevibrations provided may be of the same frequency.

[0040]Fig. 3 shows another embodiment of the present invention, in theform of a mobile telephone 14 having the apparatus of Fig. 2. Thecontroller 9, actuator 61, and the PCB 62 of the apparatus 60 of Fig. 2are encased in a case 18 of the mobile telephone 14. The mobiletelephone 14 also includes a display screen 15 capable of displayinggraphic objects 16 and alpha-numeric information 17. The alpha-numericinformation 17 that may be displayed includes phone numbers and lists,for example of list of entries in a phone book, that are input by thealpha-numeric input buttons 10 and accessed by the assignable functionbuttons 12a-12c.

[0041]Fig. 4 is a schematic representation through line 4-4 of Fig. 3illustrating that the alpha-numeric input buttons or keys 10 in themobile telephone pass through the case 18 of the mobile telephone andcontact a plurality of switches 19 disposed on the PCB 62. The switches19 are in communication with the controller 9 (not shown). Suitableswitches 19 include any analog or digital switch, for example rubberswitches, snap dome-type switches, and pressure sensitive switches.Preferably, the switches 19 are capable of producing distinct inputsignals to the controller. Even more preferably, the switches 19 arecapable of producing such signals for two or more positions. In theembodiment shown, the keys 10 contact a plurality of digital switches,each capable of producing four distinct input signals to the controller9 to correspond to the four levels at which pressure is applied to thebuttons 10 by the user.

[0042] The PCB 62, on a side opposite the switches, is in communicationwith the actuator 61. As illustrated, the actuator 61 is apiezo-electric actuator having a metal diaphragm 20 in contact with thePCB 62 through one or more spacers 21 and a piezo ceramic element 22 incontact with the metal diaphragm 20. Alternative actuator embodimentsinclude a flexure coupled to the shaft of a motor, secured to the PCB62.

[0043] As illustrated, the keys 10 are initially in a rest position 23.A biasing member arrangement (not shown) as is available and understoodin the art is used to hold the keys in the rest position 23. An object24, for example the user"s finger or a stylus, is used to select one ormore of the keys 10 by applying pressure in the direction of arrow A.This pressure causes the selected key to progress through a plurality ofpositions. As illustrated, after leaving the rest position 23, the keyspass sequentially through a second position 25, a third position, 26, afourth position 27, and a fifth position, 28 as greater and greaterpressure is applied to the button 10. The distance of travel betweeneach position does not have to be equal, and the amount of pressurerequired to move between each position can vary. In addition, for agiven key, the number of positions can vary from two (no pressure andactivated) up to the number of input signals assigned to a given key.Therefore, in the embodiment shown, a key 10i is moveable from a firstlevel (rest) 23 to a second level 25 upon the application of asufficient amount of pressure to the input device. In the embodimentshown in Fig. 3, the amount of pressure necessary to move the key 10ifrom rest 23 to the second position 25 is about equal to the amount ofpressure that user"s finger would exert upon contact with the keywithout actually selecting the key.

[0044] Accordingly, in one method of using the embodiment shown in Fig.3, when a user of the mobile telephone 14 shown in Fig. 3 presses the"9" key 10i using a relatively light amount of pressure, the button 10imoves from rest state 23 to its second level 25. Such movement causesthe button 10i to apply pressure to switch 19a, which is received byswitch 19a. The switch 19a is in communication with the controller 9.The switch 19a is configured to transmit a first signal to thecontroller 9 upon receiving a pressure of magnitude indicating thatsufficient pressure has been placed on button 10i to move from its firstlevel 23 to its second level 25. The controller 9 receives this firstsignal. The controller 9 is configured to transmit a first controlleroutput signal to the actuator 61 upon receipt of this first signal fromthe switch 19a. The controller transmits the first controller outputsignal to the actuator 61. The actuator 61 is configured to provide avibration of a first pre-selected frequency to the metal diaphragm 20 ofa pre-selected duration upon receipt of such a first signal. In theembodiment shown, the actuator 61 provides a side-to-side vibration tothe diaphragm. The diaphragm 20 thus vibrates at the pre-selectedfrequency, in turn causing the PCB 62 to vibrate at that same frequency,and thus in turn causing the switches 19 to vibrate at that frequency.The switch 19a is in communication with the button 10i, thus causing thebutton 10i to vibrate at that frequency.

[0045] When the user applies further pressure to the button 10isufficient to cause the button to move from the second level 25 to athird level 26, the button"s force is applied to switch 19a. Switch 19areceives the force and is configured to transmit a second signal to thecontroller 9 whenever it receives force to indicate that the button 10ihas moved from the second level 25 to the third level 26. The switch 19adoes so, and the controller 9 receives the second signal. The controller9 is configured to transmit a second controller output signal to theactuator 61 upon receipt of this second signal from the switch 19a. Thecontroller 61 transmits the second controller output signal to theactuator 61. The actuator 6 is configured to provide a vibration of asecond pre-selected frequency, different from the first pre-selectedfrequency, for a pre-determined duration to the metal diaphragm 20 uponreceipt of such a second signal. In other embodiments, the first andsecond pre-selected frequencies are the same. As above, the actuator 61provides a side-to-side vibration to the diaphragm, which iscommunicated through the PCB 62 and switches 19 to the button 10i.

[0046] When a user applies pressure to the button 10i, which iscommunicated to the switch 19a, at each level 25, 26, 27, 28, a distinctsignal is transmitted by the switch 19a to the controller 9. Thus, inthe embodiment shown, different signals are transmitted by the switch19a for each pressure-applied levels 25, 26, 27, 28.

[0047] In the embodiment shown, a "dwell to select"function is employed.For example, when a user provides sufficient input to cause the buttonto move to its second level 25, the first signal is transmitted to thecontroller 6 continuously while the button receives pressure to push itat or past the second level 25 but not sufficient pressure to push thebutton 10i to the third level 26. The controller 9 determines the lengthof time the button is maintained at the second level 25 by monitoringthe length of time the first signal is transmitted to the controller 9.If the first signal is received for greater than a pre-determined lengthof time, the controller determines that the user wishes to "select"thefunction associated with the second level 25 by the fact that the user"dwelled" at that level for the pre-determined time. Upon sodetermining, the controller 9 transmits a signal to a processor (notshown) indicating that the user has selected the function associatedwith the second level of button 10i, in this case the selection of theletter "W." In embodiments, the controller 9, upon so determining, alsotransmits a signal to the actuator 61 to cause the actuator 61 tovibrate at a frequency, magnitude, and/or wave-form indicative ofselection of the function.

[0048] In one embodiment, in addition to providing haptic feedback tothe input device, the controller 9 also sends a signal to the display 17to cause the alphanumeric character associated with the input signal tobe displayed. For example, in one embodiment, upon detecting thepresence of a first pressure (through receipt of a first input signal)and sufficient dwell time to indicate a selection, the controller sendsa signal to the display 17 indicating that the display should displaythe letter "X." Upon detecting the presence of a second pressure(through receipt of a second input signal) and sufficient dwell time toindicate a selection, the controller sends a signal to the display 17indicating that the display should display the letter "Y." Upondetecting the presence of a third pressure (through receipt of a thirdinput signal) and sufficient dwell time to indicate a selection, thecontroller sends a signal to the display 17 indicating that the displayshould display the letter "Z." The display 17 then displays each ofthese characters, X, Y, Z.

[0049] Various other embodiments may be employed. For example, insteadof having a single actuator to provide feedback to all input devicesreceiving such feedback, like the embodiments shown in Figs. 2-3, otherembodiments have two or more actuators. These two or more actuators maybe in communication with all or part of the input devices that providetactile feedback. The two actuators may each provide significantlydifferent types of feedback to the same set of input devices, or eachmay be in communication with a different group of input devices toprovide the same or different types of feedback. As another example, theactuator and input devices may be configured to provide vibration toonly the button that is receiving pressure from the user, or they may beconfigured to provide vibration to all buttons or at least more buttonsthan the one(s) receiving pressure from the user.

[0050] Moreover, although the actuator 61 is shown as disposed below thePCB 62 in Fig. 4, in other embodiments the actuator 61 may be disposedat other locations within the device having such apparatus, whether thedevice is a mobile telephone, PDA, or other device. Preferably, theactuator is disposed within the housing of the device. Preferably, it iscommunication with the PCB 62, but is placed anywhere in communicationwith the PCB 62 as the size and space restrictions of the applicationwill allow. In other embodiments, the actuator 61 is located outside thehousing of the device (such as beside it). In still other embodiments,the actuator 61 is in communication with the input devices other thanthrough the PCB 62.

[0051] In the embodiment shown, a distinct tactile sensation is producedfor each of the various levels at each of the various keys. In otherembodiments, the controller 6 selects one of a pre-selected group ofsensations to provide in response to the various signals received by thecontroller.

[0052]Fig. 5 shows another embodiment of the present invention.Referring to Fig. 5, a PDA 31 having an input device in the form of apressure-sensitive touchpad 30 is shown. The PDA 31 also includes aplurality of mechanical type buttons 32. The PDA 31 also includes adisplay panel 33 capable of displaying computer generated graphics.Suitable display panels include flat-panel type displays including aLiquid Crystal Display (LCD), plasma displays, Thin Film Transistor(TFT) type displays or other flat displays, such as are found in laptopsand color PDA"s, and conventional cathode ray tube displays.

[0053]Fig. 6 shows a cross-sectional view of the PDA 31 of Fig. 5 alongline 6-6. As is best displayed in Fig. 6, the display 33 is underneaththe touchpad 30 and is in communication with the touchpad 30 to transmittactile sensations thereto. The display 33 is also in communication withan actuator 64 to receive a tactile sensation therefrom forcommunication to the touchpad 30. Other arrangements of the touchpad 30,display 33 and actuator 64 are also possible including arrangements inwhich the actuator 64 is in direct contact with the touchpad 30. Thedisplay 33 is in communication with the touchpad 30 through two spacers34. Suitable spacers are constructed of a material that can transmit thetactile sensations between the display 33 and the touchpad 30. In otherembodiments, the touchpad 30 and display 33 are in direct physicalcontact, and the touchpad 30 and display are not in communication. Thetactile sensations produced in the touchpad 30 are transmitted to theobject 24 when the object 24 is brought into contact with a surface 35of the touchpad 30.

[0054] Referring again to Fig. 5, the display 33 displays a plurality ofsoftware-generated buttons or keys, called softkeys 36a-i. The softkeys36a-i provide a graphical user interface for the PDA 31 and are arrangedin a desired pattern or grid. Each softkey 36 occupies a distinctlocation on the display panel. As illustrated, the PDA 31 can functionas a mobile telephone, and the softkeys 36 are arranged as a telephonekeypad to provide the same functionality as the mechanical keys on aconventional telephone keypad. The display 33 of the PDA 31 alsoincludes additional graphical outputs 37 and areas 38 without graphicaloutput. The displayed softkeys 36 are viewable through the touchpad 30and represent corresponding unique positions on the touchpad 30.

[0055] An object 24, for example a human finger, selects a desiredsoftkey 36a-i by contacting the touchpad 30 at the appropriate location.A controller (not shown) is in communication with the touchpad 30. Thecontroller of this embodiment is similar in structure and functionalityto the controller described in relation to the embodiment of Fig. 3. Thecontroller is capable of determining the location on the display screen33 that is touched by the object 24, and the softkey 36 corresponding tothe touched location. Based upon this information, the controller causesthe actuator 64 to provide a corresponding tactile sensation. Theactuator 64 can cause vibrations in the touchpad 35 in a directionparallel to the surface 35 of the touch paid or perpendicular to thesurface 35 of the touchpad 30. The controller also determines when aninput is ambiguous, such as when two or more softkeys are simultaneouslyselected or when an area of the display containing no graphics 38 istouched, and causes the actuator to output an appropriate tactilesensation. Preferably, the same controller that controls the displayedsoftkeys 36 also controls the tactile feedback sensations produced bythe actuator 64.

[0056] Certain softkeys 36b-i represent multiple positions or multipleinputs, each input or position corresponding to a distinct amount ofpressure applied to the softkey 36b-i. This distinct amount of pressureis detected by the controller in communication with the touchpad 30.Alternatively, the apparatus can include a separate pressure calculatorto measure the amount of pressure applied to the touchpad 30 . In theembodiment shown, the amount of pressure applied to the touchpad 30 iscalculated by the controller based upon the amount of area of the object24 used to select the softkey that is in contact with the surface 35 ofthe touchpad 30.

[0057] The amount of pressure applied to the input device or to thesoftkey 36a-i on the touchpad can be determined by reading ordetermining the size or area of the contact patch created by the object24, such as the user"s finger, on the input device or softkey 36a-i. Inaddition to reading the current size of the contact patch, the rate ofchange of the contact patch can also be determined, using dynamicthresholds and to look at how fast the user"s pressure is changing. Ifthe contact patch area changes at a sufficiently large rate, thecontroller can determine that the corresponding input device or softkey36a-i is being selected.

[0058] The functionality of the softkeys shown in Fig. 5 is similar tothe mechanical key counter parts described in relation to Figs. 2 and 3.Therefore, the pressure level of a selected softkey may be moveable froma first position to a second position upon the application of asufficient amount of pressure. The amount of pressure necessary to movethe softkey 36a to the second position (the first position being at restor no contact) input device to the first position is about equal to theamount of pressure that user"s finger would exert upon contact with thetouchpad surface and sliding lightly along the surface. In thisembodiment, the controller is configured to cause the actuator toproduce a first tactile sensation when the softkey 36a is in the secondposition or when the applied pressure is less than the amount ofpressure necessary to indicate that the softkey has been selected, thatis the third position. The controller would then cause the actuator 64to produce a second tactile sensation upon receipt of the input signalassociated with the third position or upon detection of a sufficientamount of pressure applied to the softkey 36a. The softkey 36i has fivepositions associated with four distinct applied pressures and nopressure at the softkey 36i, and corresponding to the input signals forthe letters W, X, Y, and Z. A dwell to select feature can be used todetermine the desired position and associated input signal.

[0059] This functionality facilitates a user moving an object over thevarious softkeys displayed on the input device and receiving a specificfrequency or tactile sensation to signal that a particular softkey hasbeen touched. As the object 24 contacts other softkeys in the displaymatrix, additional distinct tactile sensations unique to these othersoftkeys are produced. With continued use, the user can quickly becomeaccustomed to the various distinct tactile sensations and theassociations between sensations and specific softkeys, permittingidentification and selection of softkeys or buttons by touch alone. Infact, distinct tactile sensations can be used with the same buttonregardless of the electronic device, creating a universal tactilesensation library similar to for example, a busy signal providing auniversal auditory signal that a telephone number is unavailableregardless of the type of telephone equipment used. For example, adistinct tactile sensation can be played when the object is in contactwith the "5"key, providing a "home" key indication. In addition, keyslocated on the center axis can have a single "pop" while keys in thecolumns to the left and right of the center axis have two "pops",providing an indication of the general location of the object 24 in akeypad matrix.

[0060] In another example, if the user is moving the object 24 over the"9"key, a relatively high frequency vibration can be output on all thekeys. When the pressure associated with the object is detected at the"6" key, a lower frequency vibration can be output, allowing the user todetermine which key is presently in contact with the object through thesense of touch. Since it is unlikely that a user would press or contactmore than one softkey simultaneously, a single vibrotactile actuatoroutputting the same sensation to all of the buttons simultaneously canbe used. When the user applies increased pressure to a softkey with theobject 24 and that pressure is greater than a predetermined thresholdpressure level, the function associated with that softkey is activated.

[0061]Fig. 7 is a block level diagram illustrating a representativeembodiment of the present invention. The various components communicateacross a common communication bus 39. The input devices 40 produce inputsignals in accordance with the present invention, and the input signalsare communicated to the controller 41 across the communication bus 39.The controller 41 can also receive pressure or position informationregarding the input devices associated with the received input signal.Based upon the received input signal, pressure and position data, thecontroller accesses a memory 42 to obtain the necessary data regardingthe functionality and tactile feedback associated with the receivedinput signal. In addition, the controller 41 can update data stored inthe memory as for example when the input signal relates to changing thefunctionality or input options associated with the input device thatproduced the input signal. Based upon the received functionality, thecontroller delivers a function signal to the electronic device 43 towhich the apparatus is connected. In addition, the controller 41modifies the output on the display 44 in particular where the display ispart of the input device, such as when a touchpad is used.Alternatively, the electronic device controls and updates the display.In addition, the controller can be the CPU associated with theelectronic device, and the memory can be the memory associated with theelectronic device. The arrangement of the controller, memory and displaydepends upon whether or not the apparatus is constructed as a standalonedevice that can be retrofitted into an existing electronic device or isincorporated into the electronic device itself. The controller uses thetactile feedback information received from the memory to provide thenecessary input to control circuitry 45 to drive the actuator 46 toproduce the desired tactile sensation in the appropriate input device.

[0062] Referring to Fig. 8, a flow chart illustrating a method ofproducing a tactile feedback sensation in an input device according tothe present invention is illustrated. A controller monitors an inputdevice in an apparatus 47. When a plurality of input devices areincluded in the apparatus, the controller can either monitor each inputdevice sequentially or in parallel. Although illustrated as a singlepass function, monitoring of the input devices is preferably handled asa continuous loop function.

[0063] The input device, in response to user input, provides one or moreinput signals, position data, and pressure data to the controller. Asthe controller monitors the input device, it first detects whether ornot an input signal is being generated by the input device 48. If aninput signal is being generated, the controller obtains the input signal49 associated with the input device. The controller then detects if thesame input device is generating any position data 50. If position datais being generated, the controller obtains the position data 51associated with the input device. The controller also detects if thesame input device is generating any pressure data 52. If pressure datais being generated, the controller obtains the pressure data 53associated with the input device. The controller may detect and obtainthe three types of data in any order. Preferably, the controller, whileobtaining the data, maintains an association among the input device, theinput signal, the pressure data, and the positions data. In someembodiments, the input signal includes pressure data, or data from whichthe pressure applied to the input device may be calculated, positiondata, or a combination or pressure and position data.

[0064] Having obtained the input data from the input device, or from aplurality of input devices, the controller then accesses a memory device54 in which is stored at least one database containing informationnecessary to produce the desired function in the electronic device andthe predetermined tactile sensation in an input device, and accessesthis information 55. In one embodiment, this information is in the formof associations among the detected input data, the functions of theelectronic device or apparatus, and the tactile sensations. An exemplarsgroup of associations is represented in tabular form in Fig. 9.

[0065] As is shown in the table, for any given input device, a pluralityof combinations of input signals, position data, and pressure data ispossible, and each combination relates to a specified function of eitherthe electronic device or a distinct tactile sensation. Thesecombinations vary depending on the type of input device assigned to eachinput signal and the current functionality of that input device. Thecontroller, using the data obtained from monitoring the input device,reads the table and obtains the associated function and tactile feedbackinformation.

[0066] Referring to Fig. 9, in one embodiment, a controller monitorsinput device number 5. On subsequent monitoring passes, the controllerdoes not detect either an input signal or position data, but detects adistinct pressure, Pressure 1. Based upon the information in the tableassociated with Pressure 1, the controller obtains the associatedfunction information for selecting the number "2", and information fordistinct tactile Sensation 13. The controller delivers the functioninformation to the electronic device 70 which uses that information todisplay the number "2" or to indicate that the number "2" has beenselected. The controller uses the information for distinct tactileSensation 13 to produce Sensation 13 in an input device 56, by forexample, causing an actuator to cause the input device to vibrate at afrequency associated with Sensation 13.

[0067] On a later monitoring pass, the controller detects a pressuremagnitude of pressure 3 on input device number 5. Similarly, based uponthe information in the table associated with Pressure 3, the controllerobtains the associated function information for selecting the letter"B"and information for distinct tactile Sensation 15. The controllerdelivers the function information to the electronic device which usesthat information to display the letter "B"or to enter the letter "B" ina program such as a telephone keypad. Therefore, in response to thedetection of at least two distinct pressures applied to the inputdevices, the controller has produced at least two distinct tactilesensations in the input device number 5. The controller can also detecta plurality of distinct pressures applied to input device number 5 andcan produce a plurality of distinct tactile sensations in input device5, each tactile sensation related to one of the plurality of distinctpressures. Although illustrated for a single input device, thecontroller can detect two distinct pressures for a plurality of inputdevices and can produce at least two distinct tactile sensations in eachone of these input devices. In another embodiment, the controller candetect a plurality of distinct pressures in the plurality of inputdevices and produce a plurality of distinct tactile sensations in theplurality of input devices. The distinct pressures can represent eitherdiscrete pressures or a range of applied pressure.

[0068] In another embodiment, the controller monitors input devicenumber 3, which is capable of inputting a plurality of input signals,Inputs 2A-E, to the apparatus. Each input signal corresponds to adistinct pressure applied to input device number 3, Pressures 1-5. Eachinput signal and pressure corresponds to a distinct function and adistinct tactile sensation, Sensations 5-9. In one embodiment, eachinput signal corresponds to an alphanumeric character. In thisembodiment, the controller delivers function information to theelectronic device related to displaying the proper alphanumericcharacter on an output device associated with the electronic device.Alternatively, the controller can display the associated alphanumericcharacter directly on the output device.

[0069] Referring still to Fig. 9, in another embodiment of a methodaccording to the present invention, the controller monitors input devicenumber 1 and detects a first pressure being applied on a first locationon input device number 1. Preferably, input device number 1 is atouchpad input device. In one embodiment, the first pressure is adiscrete pressure, pressure 1. In another embodiment, the first pressurerepresents a range of pressures having a value less than Pressure 1. Thefunction associated with the first applied pressure indicates that thisis the pressure range associated with a user simply searching or feelingfor the location of the desired button or key. Therefore, the controllerdoes not provide a function input to the electronic device. Thecontroller does, however, provide a first tactile sensation, Sensation1, to input device number 1.

[0070] The controller then detects an input signal, Input 1 and apressure greater than or equal to Pressure 1 at Input 1. In response,the controller delivers a function input corresponding to "Select" tothe electronic device and produces a second distinct tactile sensation,Sensation 2, in Input Device 1.

[0071] In another embodiment, the controller monitors Input Device 7 anddetects a first pressure, Pressure 1, at a first location, Location 1 onthe input device. Preferably, the input device is a touchpad inputdevice. In response, the controller provides a first tactile sensation,Sensation 20, in Input Device 7. In addition, the controller detects asecond pressure, Pressure 2, applied at a second location, Location 2,on Input Device 7. In response, the controller provides a second tactilesensation, Sensation 21 in Input Device 7. The first pressure cancorrespond to a first input signal, Input 7, and a first function,Function 1, and the second pressure can correspond to a second inputsignal, Input 8, and a second function, Function 2. The controllerdelivers the associated function input to the electronic device inresponse to each received pressure. Note that the controller may causethe actuator to include a different wave form, frequency, and/ormagnitude as tactile feedback in relation to different pressures, modes,menus, and other functionality.

[0072] The controller can also determine if any an ambiguous input isreceived 71. The ambiguous input can represent a combination of inputdevice, input signal, position data, and pressure data that is notrepresented the data contained in memory. Alternatively, an ambiguousinput signal can represent input simultaneously from two input devicesor an input from a portion of a touchpad that is not associated with aninput device. In response to receiving an ambiguous input signal, thecontroller obtains the associated ambiguous tactile feedback information72 and produces the associated distinct tactile sensation, Sensation 22,in one or more input devices associated with the ambiguous input. In oneembodiment, when the controller detects both a first and second input,the controller determines if either one of the inputs is ambiguous. Ifnot, then the controller produces the associated first and secondtactile sensations. If either input signal is ambiguous, then thecontroller produces the ambiguous output tactile sensation 56 in theappropriate input device.

[0073] Since the function corresponding to the input signals, positions,and pressures detected by the controller may involve modification of thefunctions associated with a given combination, the controller can alsoupdate the database stored in memory 57. In one embodiment, thecontroller is monitoring Input Device 6, and detects a first pressure,Pressure 1, applied to that input device. The first pressure correspondsto one of a plurality of input signals, Input 4, corresponding to afirst set of input functions, Functions 1-3. The controller obtainsFunction 1 and Sensation 17 information and produces the appropriatetactile sensation at Input Device 6. Function 1 can represent one set ofmenus from a list of menus or one operating mode out of a plurality ofoperating modes. Suitable operating modes include instant messaging,electronic mail, voice mail, games, and missed phone calls.

[0074] Since Function 1 represents a menu or mode that may haveadditional sub-menus or mode functions associated with it, thecontroller, in response to Function 1 updates the database asillustrated in Figure 10. As the controller continues to monitor InputDevice 6, it detects a second pressure 3" corresponding to one of theinput signals, Input 6, which corresponds to one function in the secondset of functions, Function 6. The controller also obtains the tactilesensation, Sensation 19", associated with the selected second setfunction and provides this tactile sensation at Input Device 6. Inaddition, the controller provides an associated function signal to theelectronic device. Suitable second set functions include sub-menus andfunctions corresponding to the selected first set function. In addition,the second set functions can include a function that returns the set offunctions to the first set of functions. Although the pressures andtactile sensations associated with the first and second set of functionscan be the same, preferably, the first pressures and tactile sensations,Pressures 1-3 and Sensations 17-19, are distinct from the secondpressures and tactile sensations, Pressures 1"-3" and Sensations17"-19".

[0075] In an embodiment of the apparatus of the present invention, forexample, the apparatus is incorporated into a mobile phone and includesan assignable-function input device and assignable function rockerswitch input device. In a main or home screen of the mobile telephonethat is displayed upon powering up the mobile telephone, the assignedfunction for the assignable-function input device is "PHONEBOOK"and therocker switch has no current function assigned to it. Light searchingpressure applied to the assignable input device and the rocker switchwill produce first and second distinct tactile sensations to indicatewhich input device is being contacted. Selecting the rocker switch willnot produce any function in the mobile phone since no function iscurrently assigned and a function failure tactile sensation, asdescribed herein, will be output through the rocker switch. Selectingthe assignable input device will place the mobile telephone in"Phonebook"mode and a third distinct tactile sensation will be outputthrough the assignable input device.

[0076] A list of phonebook entries is now displayed on the screen of themobile telephone. The assignable input device is assigned the function"SELECT" and the rocker switch is assigned a scroll function. Lightpressure on the assignable input device or the rocker switch produce afourth and fifth distinct tactile sensations, indicating that the mobilephone and the input devices are in "Phonebook"mode. Selecting the rockerswitch to either scroll up and down produces bumps or clicks associatedwith scrolling a list of entries in the rocker switch. Special clickscan be output for passing each alphabetical tab in the phonebook or forpassing frequently called entries. In one embodiment, an analog switchis included under the rocker switch to provide an analog signal roughlyin proportion to the pressure registered on the rocker switch. Thisallows the list that is being scrolled to be scrolled at a rate that canbe controllable with the amount of pressure applied, and which iscommunicated to the user by corresponding increase in the rate of hapticevents played on the rocker switch. Once the rocker switch has been usedto highlight the desired entry, the assignable input device is pushed toselect that entry and a sixth distinct tactile sensation is outputthrough the assignable input device.

[0077] The assignable input device continues to be assigned the functionof select and the rocker switch is still used as a scrolling device. Thedisplay of the mobile telephone, however, display another menu listcontaining the functions "EDIT", "VIEW", "CALL", and "DELETE". Lightpressure on assignable input device and rocker switch again produces thefourth and fifth tactile sensations, indicating that the "Phonebook"mode or function is still active. Using the rocker switch to scroll upor down through the list again produces a click in the rocker switch aseach entry is passed. The magnitude of each click and the spacingbetween clicks can be varied to indicate that a relatively short list isbeing scrolled. In addition to a click, seventh, eighth , ninth andtenth distinct tactile sensations as output to the rocker switch as theswitch scrolls past "EDIT", "VIEW", "CALL", and "DELETE"respectively.Scrolling is stopped on the "CALL" entry, and the assignable inputdevice is pushed, calling the number associated with the chosen entryfrom the phonebook. In addition, the ninth tactile sensation is outputto the assignable input device. An attempt to active one of thefunctions, such as "CALL", before the device is ready causes thecontroller to indicate that the function is available.

[0078] Various other functions may be initiated by using the buttons.For example, in a mobile telephone having the functionality of instantmessaging, electronic mail, voice mail, games, and missed call read-out,the user may select one of these functions. In an embodiment, a distincttactile sensation is initiated by the controller whenever the userinitiates one of these functions, and the distinct tactile sensation isdifferent for each function.

[0079] Regardless of the input device being monitored by the controller,upon detection of first and second input signals, first and secondpressures or first and second positions and obtaining the associatedfirst and second functions, the controller can determine if thesefunctions are available for execution 58. Alternatively, the controllerprovides the necessary function signals to the electronic device whichdetermines the availability of those functions. If the first and secondfunctions are available, then the controller produces the associatedtactile sensations in the appropriate input devices. If one of the firstor second functions are not available then the controller obtains thetactile sensation information for the tactile sensation associated withfunction failure 59, Sensation 23, and produces that sensation in theappropriate input device. Examples of function failure include selectingthe re-dial feature on a telephone when no number is stored in there-dial memory, attempting to access a program or menu for which theuser does not have authority to access, and attempting to initiate amobile telephone call having entered an incomplete phone number.

[0080]Figure 11 aids in illustrating another embodiment of the presentinvention. In one embodiment of the present invention, a device provideshaptic feedback while navigating a menu structure, allowing a user tonavigate the menu structure more efficiently, preferably without havingto refer to the visual display. In such an embodiment, an actuatorgenerates distinct sensations that represent various sections of themenu structure, specific menu options, and events that occur whilenavigating the menu structure.

[0081] For example, in one embodiment, each of the highest level or mainmenu options corresponds to a distinct vibrotactile sensation thatvaries in pitch. As the user navigates between the main menu topics, theactuator produces a distinct number of pulses. The varying pitchcombined with the alternating pulses provides feedback that identifiesto the user the menu currently selected or highlighted.

[0082] In another embodiment, the number of occurrences of a distinctvibrotactile sensation, such as a pop, corresponds to the index numberof the menu option within a list of menu options. In such an embodiment,one pop signifies the first option; two pops signifies the secondoption. In yet another embodiment, a distinct vibrotactile effectsignifies that the user is cycling from the end of a particular menuback to the beginning ("rolling over").

[0083]Fig. 11 is a front view of a personal digital assistant (PDA) 100in one such embodiment of the present invention. The PDA 100 includes adisplay 102, a plurality of buttons, including button 104, for executingspecific functions and applications, and a 5-way directional pad (D-pad)105 for navigation within the various interfaces displayed on the PDA100. With the 5-way D-pad, a user clicks the directional keys to move upand down and left and right through the menu structure and clicks thecenter of the D-pad to select a particular option. In the embodimentshown, the active application is displaying a menu structure. The menustructure 108 includes main menu topics 110. Selection of the main menutopics results in either the display of a sub-menu or the execution ofan associated function or application. In the embodiment shown,selection of the File menu option on the main menu 110 results in thedisplay of a sub-menu 112. As with the main menu options, selection ofany of the topics on the sub-menu 112 results in either the display of asecondary sub-menu or the execution of an associated function orapplication. For example, selection of the Send To option on sub-menu112 results in display of secondary sub-menu 114.

[0084] In the embodiment shown in Figure 11, a user presses button 104to activate an application. Within the application, the user utilizesD-pad 106 to navigate to the main menu 108. An actuator (not shown) asdescribed herein, such as an eccentric rotating mass or voicecoil,provides a brief, distinct haptic effect as the user highlights each ofthe options in the main menu 108. The effect may change in pitch or insome other manner to alert the user to the fact that the highlightedoption has changed. The user may either click the center of the D-pad106 to select an option or click the down arrow. Performing either ofthese actions over the File option produces sub-menu 112.

[0085] The user clicks the down arrow to move through the sub-menu 112.In the embodiment shown, when a directional arrow of the D-pad 106 isheld down, the menu options in sub-menu 112 scroll at a fixed rate, anda haptic effect plays with each option that appears below the cursor.The longer the directional arrow is held down, the faster the rate ofscrolling. The PDA 100 communicates the rate of scrolling by acorresponding change in the haptic effect, such as an increase infrequency. If the user clicks the right arrow when the cursor highlightsthe Send To option, the secondary sub-menu 114 is displayed. Navigationthrough the secondary sub-menu 114 occurs in a manner similar to thatwhich occurs in sub-menu 112. To select an option within the secondarysub-menu 114, the user clicks the center of the D-pad 106. Clicking thecenter of the D-pad 106 triggers the playing of yet another distincthaptic effect. In addition, the D-pad switch 106, either a 5-way or a4-way, can provide haptic effects indicating the direction that theswitch was being pressed.

[0086] The embodiment shown in Figure 11 is applicable to a variety ofapplications, particularly to applications that display lists. Forexample, in one embodiment, an address book containing a list of namesis displayed on the PDA 100. In such an embodiment, the actuator playsan effect as the user scrolls through the list. Further, the actuatorplays a distinct haptic effect as the user navigates from names startingwith one letter, for example A, to the next letter, B. Such anembodiment may also include a distinct effect corresponding to namesthat the user has previously identified as favorites in the addressbook.

[0087] Another embodiment of the present invention provides the userwith distinct haptic effects corresponding to the operational mode of anelectronic device. For example, in an embodiment utilizing a PDA, suchas PDA 31 in Fig. 5, a user may activate one of many modes, including,for example, the phone interface shown in Fig. 5, the applicationinterface shown in Fig. 11, an address book, email, or other modes.Referring to Fig. 5, in one such embodiment, the user clicks a button 32to activate the phone application. When the user clicks the button, thePDA 31 displays a phone interface 38. While the PDA 31 is in phone mode,the actuator provides a persistent haptic effect indicating to the userthat the phone mode is active. In this way, the user is able todetermine the mode of the PDA 31 without visually referring to it.

[0088] Another embodiment of the present invention provides the userwith distinct haptic effects for modes within a cell phone or otherelectronic device. Referring to Fig. 3, users of cell phones, such ascell phone 14, often store a list of number that are frequently dialedin a memory associated with one or a combination of number keys 10. Insuch an embodiment, the user may click a function key before clickingthe number key 10, providing a signal to the phone 31 that the user willspecify a number to dial by clicking a number key combination. In oneembodiment of the present invention, when the user clicks the functionbutton, the actuator provides a persistent haptic effect, indicating tothe user that the cell phone is in the rapid-dialing mode. The hapticeffect alerts the user to the fact that when the user selects anumber-key combination, the cell phone will dial the phone numberassociated with the number-key combination in memory. By providing ahaptic effect identifying the mode that the cell phone 31 is in, theembodiment minimizes or eliminates the user"s need to refer to the cellphone 31 visually.

[0089] In another embodiment of the present invention, an actuatorprovides feedback when an option or function is unavailable (referred toherein as "negative feedback"). In such an embodiment implemented in acell phone, such as cell phone 31 shown in Fig. 3, the user is able toplace calls. The user dials a combination of number keys 10 and thenpresses the send key 11 to execute the phone call. In an embodimentutilizing negative feedback, if the user enters an invalid phone number,for example, a phone number including only 6 digits, the cell phoneprovides negative feedback, indicating that the send function is notavailable. The negative feedback may, for example, comprise a very lowfrequency buzz. In another embodiment, the actuator provides negativefeedback to the user if the user clicks a redial button (not shown)without having previously dialed a number.

[0090] Other embodiments and uses of the present invention will beapparent to those skilled in the art from consideration of thisapplication and practice of the invention disclosed herein. The presentdescription and examples should be considered exemplary only, with thetrue scope and spirit of the invention being indicated by the followingclaims. As will be understood by those of ordinary skill in the art,variations and modifications of each of the disclosed embodiments,including combinations thereof, can be made within the scope of thisinvention as defined by the following claims.

Claims 1.A computer-readable medium having instructions, theinstructions including instructions that cause a processor to:detect afirst pressure on a first input device;provide a first tactile sensationto the first input device;detect a second pressure on the first inputdevice, the second pressure greater than the first pressure; andprovidea second tactile sensation to the first input device. 2.Thecomputer-readable medium of claim 1 further comprising storedinstructions, the stored instructions including instructions which, whenexecuted by a processor, cause the processor to: detect a third pressureon the first input device, the third pressure greater than the secondpressure; andprovide a third tactile sensation to the first inputdevice. 3.The computer-readable medium of claim 2 further comprisingstored instructions, the stored instructions including instructionswhich, when executed by a processor, cause the processor to: detect afourth pressure on the first input device, the fourth pressure greaterthan the third pressure; andprovide a fourth tactile sensation to thefirst input device. 4.The computer-readable medium of claim 1, the firsttactile sensation different from the second tactile sensation. 5.Thecomputer-readable medium of claim 1 further comprising storedinstructions, the stored instructions including instructions which, whenexecuted by a processor, cause the processor to provide the firsttactile sensation to a second input device. 6.The computer-readablemedium of claim 5 further comprising stored instructions, the storedinstructions including instructions which, when executed by a processor,cause the processor to provide the second tactile sensation to thesecond input device. 7.The computer-readable medium of claim 1 furthercomprising stored instructions, the stored instructions includinginstructions which, when executed by a processor, cause the processorto: detect a third pressure on a second input device; and provide athird tactile sensation to the second input device. 8.Thecomputer-readable medium of claim 7, the third tactile sensationdifferent from the first tactile sensation. 9.The computer-readablemedium of claim 7 further comprising stored instructions, the storedinstructions including instructions which, when executed by a processor,cause the processor to: detect a fourth pressure on the second inputdevice, the fourth pressure greater than the third pressure; and providea fourth tactile sensation to the second input device. 10.Thecomputer-readable medium of claim 1, the first tactile sensationdifferent from the second tactile sensation. 11.The computer-readablemedium of claim 10, the first tactile sensation comprising a differentfrequency than the second tactile sensation. 12.The computer-readablemedium of claim 1, the first input device comprising a button on amobile telephone. 13.The computer-readable medium of claim 1, the firstinput device comprising a soft-key on a touchpad. 14.Thecomputer-readable medium of claim 2 further comprising storedinstructions, the stored instructions including instructions which, whenexecuted by a processor, cause the processor to: upon detecting thefirst pressure, provide a first signal indicating a first alphanumericcharacter; upon detecting the second pressure, provide a second signalindicating a second alphanumeric character; and upon detecting the thirdpressure, provide a third signal indicating a third alphanumericcharacter. 15.The computer-readable medium of claim 14 furthercomprising stored instructions, the stored instructions includinginstructions which, when executed by a processor, cause the processorto: upon detecting the first pressure, display the first alphanumericcharacter; upon detecting the second pressure, display the secondalphanumeric character; and upon detecting the third pressure, displaythe third alphanumeric character. 16.The computer-readable medium ofclaim 1, the second pressure on the first input device comprising acontinuous rise in pressure from the first pressure. 17.Acomputer-readable medium having stored instructions, the storedinstructions including instructions that, when executed by a processor,cause the processor to: detect a first pressure on a first input devicecomprising requesting a function; and provide a first tactile sensationto the first input device indicating initiation of the function. 18.Thecomputer-readable medium of claim 17, the function comprising initiationof a menu. 19.The computer-readable medium of claim 18, the menucomprising a first sub-menu, and the computer-readable medium furtherhaving stored instructions, the stored instructions includinginstructions which, when executed by a processor, cause the processorto: provide a second tactile sensation indicating initiation of thefirst sub-menu. 20.The computer-readable medium of claim 19, the menucomprising a second sub-menu, and the computer-readable medium furtherhaving stored instructions, the stored instructions includinginstructions which, when executed by a processor, cause the processorto: provide a third tactile sensation indicating initiation of thesecond sub-menu. 21.The computer-readable medium of claim 19, the firsttactile sensation different than the second tactile sensation. 22.Thecomputer-readable medium of claim 21, the second tactile sensationdifferent than the third tactile sensation. 23.The computer-readablemedium of claim 17, the function comprising an operation mode. 24.Thecomputer-readable medium of claim 23, the operation mode comprising atleast one of the following: instant messaging, electronic mail, voicemail, game, and missed calls. 25.The computer-readable medium of claim17, the first tactile sensation indicating a structure of the menu.26.The computer-readable medium of claim 25, the menu comprising atleast one sub-menu. 27.The computer-readable medium of claim 26, thefirst tactile sensation further indicating the number of sub-menuscomprising the menu. 28.A computer-readable medium having storedinstructions, the stored instructions including instructions that, whenexecuted by a processor, cause the processor to: detect a first pressureat a first location on a touchpad; upon detecting the first pressure,provide a first tactile sensation to the touchpad; detect a secondpressure at a second location on a touchpad; upon detecting the secondpressure, provide a second tactile sensation to the touchpad, the firsttactile sensation having a different waveform than the second tactilesensation. 29.The computer-readable medium of claim 28, the firsttactile sensation further having a different magnitude than the secondtactile sensation. 30.The computer-readable medium of claim 28, thefirst tactile sensation further having a different frequency than thesecond tactile sensation. 31.The computer-readable medium of claim 28having stored instructions, the stored instructions includinginstructions which, when executed by a processor, cause the processorto: detect a third pressure on the touchpad comprising requesting afunction; determine that the function is unavailable; and upondetermining that the function is unavailable, provide a third tactilesensation to the touchpad. 32.The computer-readable medium of claim 28having stored instructions, the stored instructions includinginstructions which, when executed by a processor, cause the processorto: detect a third pressure on the touchpad; determine that the thirdpressure comprises an ambiguous input; upon determining that the thirdpressure comprises the ambiguous input, provide a third tactilesensation to the touchpad. 33.A computer-readable medium having storedinstructions, the stored instructions including instructions that, whenexecuted by a processor, cause the processor to: detect a first pressureat a first location on a touchpad; upon detecting the first pressure,provide a first tactile sensation to the touchpad; detect a secondpressure at a second location on a touchpad; upon detecting the secondpressure, provide a second tactile sensation to the touchpad, the firsttactile sensation having a different wave form than the second tactilesensation. 34.The computer-readable medium of claim 33, the firsttactile sensation further having a different magnitude than the secondtactile sensation. 35.The computer-readable medium of claim 33, thefirst tactile sensation further having a different frequency than thesecond tactile sensation. 36.The computer-readable medium of claim 33having stored instructions, the stored instructions includinginstructions which, when executed by a processor, cause the processorto: detect a third pressure on the touchpad comprising requesting afunction; determine that the function is unavailable; and upondetermining that the function is unavailable, provide a third tactilesensation to the touchpad. 37.The computer-readable medium of claim 33having stored instructions, the stored instructions includinginstructions which, when executed by a processor, cause the processorto: detect a third pressure on the touchpad; determine that the thirdpressure comprises an ambiguous input; upon determining that the thirdpressure comprises the ambiguous input, provide a third tactilesensation to the touchpad. 38.A computer-readable medium having storedinstructions, the stored instructions including instructions which, whenexecuted by a processor, cause the processor to: detect a first pressureon a first input device comprising requesting a function; determine thatthe function is unavailable; and upon determining that the function isunavailable, provide a first tactile sensation to the first inputdevice. 39.The computer-readable medium of claim 38 having storedinstructions, the stored instructions including instructions which, whenexecuted by a processor, cause the processor to: determine that thefunction is available; and upon determining that the function isavailable, provide a second tactile sensation to the first input device,the second tactile sensation different from the first tactile sensation.40.The computer-readable medium of claim 39, the second tactilesensation comprising a different frequency than the first hapticfeedback. 41.A computer-readable medium having stored instructions, thestored instructions including instructions that, when executed by aprocessor, cause the processor to: detect a first pressure on a firstinput device; determine that the first pressure comprises an ambiguousinput; upon determining that the first pressure comprises the ambiguousinput, provide a first tactile sensation to the first input device.42.The computer-readable medium of claim 41, wherein determining thatthe first pressure comprises an ambiguous input further comprisesdetecting a second pressure on a second input device. 43.Thecomputer-readable medium of claim 42, wherein determining that the firstpressure comprises an ambiguous input further comprises detecting thefirst pressure on the first input device approximately simultaneous tothe second pressure on the second input device. 44.The computer-readablemedium of claim 1, wherein determining the first pressure on the firstinput device comprises receiving a first input signal. 45.Thecomputer-readable medium of claim 1, wherein providing the first tactilesensation to the first input device comprises transmitting a firstcontroller output signal to an actuator in communication with the firstinput device. 46.An input device, comprising: a means for determiningpressure; and an actuator in communication with the means fordetermining pressure and capable of creating at least three distincttactile sensations in response to at least three corresponding pressureinput signals from the means for determining pressure. 47.The inputdevice of claim 46, wherein one of the at least three correspondingpressure input signals indicates a rest state. 48.The input device ofclaim 46, further comprising a controller in communication with themeans for determining pressure and with the actuator, the controllerconfigured to cause the actuator to create the at least three distincttactile sensations in response to at least three corresponding pressureinput signals from the means for determining pressure. 49.The inputdevice of claim 48, further comprises a second actuator in communicationwith the controller. 50.The input device of claim 46, wherein the inputdevice comprises at lest one of an analog switch, a force sensingresistor, a strain gauge based sensor, a capacitative touch switch, anda touchpad. 51.The input device of claim 46, further comprising a secondmeans for determining pressure. 52.The input device of claim 51, thesecond means for determining pressure in communication with the firstactuator. 53.The input device of claim 51, further comprising a secondactuator. 54.The input device of claim 53, the second means fordetermining pressure in communication with the second actuator. 55.Theinput device of claim 46, further comprising a plurality of means fordetermining pressure. 56.The input device of claim 46, furthercomprising a second actuator. 57.The input device of claim 46, furthercomprising a plurality of actuators. 58.The input device of claim 46,the first actuator comprising at least one of a piezo-electric actuator,a voice coil, a moving magnet actuator, eccentric rotating mass, and aflexure coupled to a motor. 59.The input device of claim 46, the meansfor determining pressure comprising a pressure-sensitive touchpad.60.The input device of claim 59, further comprising a display panel incommunication with the pressure-sensitive touchpad, the display panelconfigured to display at least one softkey. 61.The input device of claim60, further comprising a pressure analyzer configured to calculate thepressure applied to the at least one softkey. 62.The input device ofclaim 61, the pressure analyzer configured to calculate the pressureapplied to the at least one softkey based at least in part on an amountof area of the softkey receiving contact. 63.A mobile phone comprisingthe input device of claim
 46. 64.The input device of claim 46, the firstactuator configured to produce a distinct tactile sensation upon afunction failure. 65.The input device of claim 64, the function failureindicating a function unavailability. 66.An apparatus comprising: atleast one input device comprising: a first position, corresponding to afirst input signal; and a second position, corresponding to a secondinput signal; the input device moveable from the first position to thesecond position upon application of a sufficient amount of pressure tothe input device; at least one actuator in communication with the inputdevice to output tactile sensations to the input device; and at leastone controller in communication with the input device to detect thefirst input signal and the second input signal and in communication withthe actuator to cause the actuator to create a first tactile sensationin response to detection of the first input signal and to create asecond tactile sensation in response to detection of the second inputsignal. 67.The apparatus of claim 66, the input device comprising atleast one of an analog switch, a force sensing resistor, a strain gaugebased sensor, a capacitative touch switch, and a touchpad. 68.Theapparatus of claim 66, the at least one input device comprising aplurality of input devices, and the at least one actuator comprising aplurality of actuators, each actuator coupled to a distinct inputdevice. 69.The apparatus of claim 66, wherein the actuator comprises atleast one of a piezo-electric actuator, a voice coil, a moving magnetactuator, and a flexure coupled to a motor. 70.The apparatus of claim66, the input device comprising a pressure-sensitive touchpad, and theapparatus further comprising: a display panel capable of displayingcomputer software generated graphics, the display panel in communicationwith the pressure-sensitive touchpad to receive the tactile sensationsthere from; and at least one software generated button disposed on thedisplay panel. 71.The apparatus of claim 66, the touchpad comprising apressure calculator to measure the distinct amount of pressure. 72.Theapparatus of claim 66, further comprising: an object to select one ofthe buttons by pressing a location of the display panel corresponding tothat button; and a pressure calculator to calculate the distinct amountof pressure based upon an amount of area of the object in contact withthe display panel. 73.The apparatus of claim 66, the apparatuscomprising at least one of a mobile telephone, a personal computer and ahand-held computing device. 74.An apparatus comprising: an input deviceto communicate an input signal to an electronic device, the input devicehaving multiple positions; at least one actuator in communication withthe input device to output a plurality of distinct tactile sensations tothe input device; and at least one controller in communication with theinput device to receive the input signal and to detect the position ofthe input device and in communication with the actuator to produce thedistinct tactile sensations corresponding to the received input signaland the detected position of the input device. 75.The apparatus of claim74, the actuator capable of varying the magnitude of the producedtactile sensation in accordance with the detected position of the inputdevice. 76.The apparatus of claim 74, further comprising a plurality ofinput devices, each input device capable of communicating a unique inputsignal to the electronic device and having multiple positions, theactuator capable of producing the distinct tactile sensationcorresponding to both the received input signal and the detectedposition of the associated input device. 77.The apparatus of claim 74,the input device associated with the selection of at least one functionof the apparatus, and the actuator further produces a function failurenotification tactile sensation upon receipt of the input signalassociated with the function and notification of failure of thatfunction. 78.A mobile phone comprising the apparatus of claim
 76. 79.Themobile phone of claim 78, comprising a keypad comprising the pluralityof input devices. 80.The mobile phone of claim 78, the at least oneactuator comprising a plurality of actuators, each actuator coupled to aseparate input device. 81.The mobile phone of claim 78, comprisingselect keys associated with function input signals to activate apredetermined mobile phone function, the actuator to produce the tactilesensation associated with each mobile phone function upon receipt of theassociated function input signal. 82.The mobile phone of claim 81, theactuator to produce a function failure notification tactile sensationupon receipt of a function input signal and notification of failure ofthat function.